Apple announces Siri AI will enhance Photos and more

Getting your Trinity Audio player ready...

As part of its WWDC26 conference, Apple Inc. has rebranded its AI efforts to “Siri AI,” promising greater integration with the entire Apple OS ecosystem, including iOS 27, iPadOS 27, macOS 27, watchOS 27, visionOS 27, and tvOS 27.

Siri AI is an entirely new version of Siri deeply integrated into iPhone, iPad, Mac, Apple Watch, and Apple Vision Pro, the company said, adding “It can draw on personal context understanding to search across messages, emails, photos, and more, and get things done across apps with even more systemwide app actions.”

Additional features coming this fall:

  • Apple iOS 27 shared albums

    iCloud Shared Albums introduce cross-platform photo sharing with full-resolution support.

  • The Health app brings support for perimenopause and menopause in Cycle Tracking, including notifications about cycle deviations inclusive of perimenopause.
  • On Apple Watch, a new dynamic app grid features the icons for five Siri-suggested apps, users can open a widget in the Smart Stack with a new tap gesture, and a new Find My app consolidates Find Devices, Find Items, and Find People.
  • AirPods users can now enjoy custom EQ to further personalize how their AirPods sound. And with expanded Apple GymKit functionality, users with AirPods Pro 3 can sync their heart rate data through iPhone while enjoying incredible audio quality.
  • Apple Vision Pro users can now turn panoramas into spatial scenes and use them as personal Environments, and connecting to Wi-Fi is up to 3x faster.
  • Apple Maps brings an enhanced Flyover experience, which combines aerial imagery with AI, allowing users to enjoy even more detailed visuals.

On iPhone, Siri’s multimodal capabilities are integrated right into the Camera app with a brand-new Siri mode, allowing users to get information and take action on what’s in front of them. Users can simply tap the shutter button to let Siri see what they see and receive useful responses. Siri mode in Camera also includes a rich new set of actions, including the ability to split a bill with friends using Apple Cash, get nutritional insights about a plate of food, and more, the company claims.

For the first time, Visual Intelligence with Siri also comes to iPad and Mac, allowing users to search visually, ask questions, and take action on their screen seamlessly. On iPad, Visual Intelligence is integrated right into the screenshot experience. On Mac, users can tap into it with a dedicated keyboard shortcut, allowing them to select something on their Mac display and type directly to Siri to get a helpful answer.

Apple iOS 27 personal context in photos

The Photos app taps into image models so users can make incredible edits, while respecting the original moment as it was captured. Photos adjusted with Apple Intelligence will automatically include a hidden SynthID watermark to identify those that have been edited with AI.

With Spatial Reframing, users can improve the composition of a photo after it’s been taken. Spatial Reframing builds on Apple’s deep understanding of spatial models thanks to Apple Vision Pro, so users can touch and drag a photo and preview in real time how the perspective shifts, as if they’d repositioned the camera in the original scene, the company said. Spatial Reframing will only generate new content where the perspective has been shifted, ensuring the reframed photo stays consistent with the original scene.

Users can also expand images with the Extend tool to give their subjects more breathing room. For example, they can straighten a crooked horizon without cropping out anything important, or adjust the aspect ratio, and Extend will fill in the missing pieces. Additionally, the popular Clean Up tool gets a major upgrade, so users can remove distractions with better quality and more realistic infill, even when the scene is complex.

These new features are available for testing starting today through the Apple Developer Program at developer.apple.com, and a public beta will be available through the Apple Beta Software Program next month at beta.apple.com.

Users who enable Apple Intelligence on supported products set to a supported language will have access this fall with iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27.

Written by 

Gary Pageau is principal of InfoCircle LLC, continuing his marketing communications career. InfoCircle LLC is a marketing and communications consulting firm, specializing in business-to-business markets. For nearly 25 years, he was with PMA International, serving most recently as Publisher, Content Development and Strategic Initiatives. His primary responsibilities included overseeing the Association’s editorial department, marketing research unit, education and corporate relations department.